DOCUMENT RESUME 



ED 418 621 



HE 030 883 



AUTHOR 
TITLE 
PUB DATE 
NOTE 

PUB TYPE 
EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



Bowman, R. ; Snowdon, K. 

Quiet Please: Indicators at Work. 

1997-05-00 

14p . ; Paper presented at Annual Forum of the Association for 
Institutional Research (Orlando, FL, May 18-21, 1997) . 

Reports - Descriptive (141) -- Speeches/Meeting Papers (150) 

MF01/PC01 Plus Postage. 

* Accountability; College Administration; College Planning; 
Educational Improvement; ^Educational Policy; Foreign 
Countries; Government School Relationship; Higher Education; 
* Institutional Evaluation; Institutional Research; 
^Universities 

♦Performance Indicators; *Queens University of Kingston 
(Canada) 



ABSTRACT 



This paper examines the development and use of performance 
indicators in higher education, focusing on the experience of Queen's 
University (Ontario) . It reviews factors influencing the development of 
performance indicators, such as the growing concern for accountability in 
public higher education and the university community's apparent inability to 
develop and communicate what are regarded as effective accountability 
mechanisms of its own. The paper goes on to examine the role of indicators in 
the planning and policy process, including the improvement of educational 
quality and the perception of the university. It reviews the role of 
indicators in developing an accountability framework, something that Queen's 
University has done to help assess progress toward key institutional goals. 
The paper notes that the role of indicators in government relations includes 
communicating the successes and shortcomings of institutions to inform 
government administrators, elected officials, and the general public. 
Implications for institutional research include the improvement of 
organizational effectiveness and accountability. (Contains 13 references.) 
(MDM) 
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Quiet Please: Indicators at Work 1 



Increasing interest in measures of accountability must be seen as an 
opportunity for post-secondary institutions to improve and strengthen the 
relationship with public sector and private sector constituents. This paper 
focuses on the policy and planning framework for the use of such indicators in 
a specific institution and points toward the use of indicators as one of the 
vehicles to address the issues surrounding accountability. The use of 
indicators to 'tell the story' to government is one aspect of a broader initiative 
to improve government relations. Implications for institutional research are 
explored with an emphasis on improving organizational effectiveness. 

Introduction 

The term "performance indicators" is now an integral part of the higher 
education lexicon. Yet within the higher education sector there are divergent 
views about the utility of and rationale for such indicators. As a potentially 
blunt resource allocation instrument of government, indicators are viewed as 
an external threat impinging on institutional autonomy and regarded, at best, 
as superficial information and, at worst, dangerously misleading. Viewed in 
another light, however, the interest in performance indicators provides an 
opportunity for institutions to strengthen existing management processes, deal 
directly with increasing calls for public accountability, and broaden the 
understanding about the work of the university. 

Purpose 

The purpose of this paper is fourfold: 

0 to highlight some of the common factors influencing the development 
of indicators; 

0 to focus attention on the role of indicators in a particular institution; 

0 to highlight the use of indicators to address accountability concerns with 
a special emphasis on government relations; and 
0 to explore the changing role of institutional research with particular 
emphasis on improving organizational effectiveness. 

Driven primarily by external pressure for indicators - as part of a cry for greater 
accountability - universities have responded in a variety of primarily defensive 
ways, appearing to have lost sight of the fact that indicators are a normal part of 

1 . Parts of this papier represent an update to The Use and Potential of Performance Indicators, presented by Ken 
Snowdon at the Halifax Conference of the Canadian Institutional Researchers and Planners Association, August, 1994. 
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the evaluation process and are already evident in many of the key evaluation 
processes within many post-secondary institutions. What has been lacking is 
an articulation of how indicators 'fit' into the management of institutions 
through the policy and planning process, their place in addressing 
accountability issues, and their role in the necessary communication strategy to 
'tell the institutional story/ Institutional researchers and planners have a key 
role to play in the development and utilization of indicators to accomplish 
those goals. 

But, it is not easy. Using indicators to help evaluate institutional policies or 
practices requires significant effort and commitment and a willingness to probe 
into many aspects of a particular issue. Using indicators to help address 
accountability issues requires a concerted effort to address accountability from 
an institutional perspective and will require the co-ordination and efforts of 
individuals from various parts of the institution. 

Factors Influencing the Development of Indicators 

Over the past decade, interest in performance indicators has exploded. Various 
state reviews in the United States and provincial reviews of higher education 
in Canada have called for the implementation of indicators and magazine 
"rankings" of institutions have simply heightened interest in the area. In 
Canada, proposals to use indicators in some fashion to allocate resources have 
been discussed in at least two provinces (Alberta and Nova Scotia) and 
Alberta's Key Performance Indicator (KPI) initiative is well underway. 2 

Indicators have been the subject of intense debate in a host of countries and, in 
some cases, have been incorporated into funding mechanisms as governments 
strive for greater return on the public investment. In other jurisdictions, 
indicators are increasingly tied directly to accountability concerns. There are a 
number of common threads in various jurisdictions that tie the experiences 
together. Interest in greater accountability is one. Improving outcomes is 
another. Nadeau (1992) outlined twenty-eight potential uses of indicators. 
Overviews of experiences with indicators in a number of countries provide 
interesting and useful perspectives on the major forces influencing the 
development of indicators and also point towards the differing emphases for 
the use of such indicators (Kells 1990; Cave et al 1991; Nedwek and Neal 1993; 
Davis 1996). 



2. Beginning in 1997/98, Alberta will incorporate performance indicators into the regular funding formula. 
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